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Abstract 

Phosphorelays are a class of signaling mechanisms used by cells 
to respond to changes in their environment. Phosphorelays (of which 
two-component systems constitute a special case) are particularly abun- 
dant in prokaryotes and have been shown to be involved in many fun- 
damental processes such as stress response, osmotic regulation, viru- 
lence, and chemotaxis. We develop a general model of phosphorelays 
extending existing models of phosphorelays and two-component sys- 
tems. We analyze the model analytically under the assumption of 
mass-action kinetics and prove that a phosphorelay has a unique sta- 
ble steady-state. Furthermore, we derive explicit functions relating 
stimulus to the response in any layer of a phosphorelay and show that 
a limited degree of ultrasensitivity (the ability to respond to changes 
in stimulus in a switch-like manner) in the bottom layer of a phos- 
phorelay is an intrinsic feature which does not depend on any reaction 
rates or substrate amounts. On the other hand, we show how adjust- 
ing reaction rates and substrate amounts may lead to higher degrees of 
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ultrasensitivity in intermediate layers. The explicit formulas also en- 
able us to prove how the response changes with alterations in stimulus, 
kinetic parameters, and substrate amounts. Aside from providing bio- 
logical insight, the formulas may also be used to avoid time-consuming 
simulations in numerical analyses and simulations. 

1 Introduction 

Throughout the course of evolution, hving organisms have developed a variety 
of different cellular mechanisms capable of responding to external stimulus, 
and post-translational modification of proteins is common to many of these 
mechanisms. In particular, modification by phosphorylation is widespread, 
and it is estimated that about 30% of all proteins undergo modification by 
phosphorylation [T]. 

One particular type of phosphorylation mechanism is the so-called phos- 
phorelay in which a phosphate group is transferred via a series of proteins 
through binding [2], [3l HJ [5]. Phosphorelays are particularly abundant in 
prokaryotes, but systems have also been identified in eukaryotes. Common 
to all phosphorelays are two proteins, a histidine kinase (HK) and a response 
regulator (RR). Upon sensing external stimulus, a histidine residue on the 
HK autophosphorylates using ATP, and the phosphate group is transferred 
to an aspartate residue on the RR, either directly or through a series of 
intermediate steps. When phosphorylated, an output domain of the RR is 
capable of adjusting the cellular response. 

Four examples of phosphorelays are shown in Figure |l| The EnvZ/OmpR 
system in E. coli is involved in osmoregulation of porin genes |H E]. Since it 
comprises only two components, the HK and the RR, it is also referred to as 
a two-component system (TCS). A slightly more complicated TCS example 
is the BvgS/BvgA system in B. pertussis, used by the bacterium to activate 
virulence genes [H El |H] , where the HK contains three phosphorylation sites. 
Some systems have one or more intermediate phosphotransfer modules, as is 
e.g. the case for the osmoregulation pathway Slnlp/Ypdlp/Ssklp in S. cere- 
visiae [ll[9l|10] and the sporulation initiating pathway SpoOA/SpoOF/SpoOB/SpoOA 
in B. subtilis [2 [IH US US] . 

The phosphorelays mentioned above are among the most well-described 
examples in the literature, but they only constitute a small fraction of the 
several hundreds of phosphorelays known [U [H], and studies of completed 
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Figure 1: Examples of phosphorelays with different architectures. The 
EnvZ/OmpR and BvgS/BvgA are both examples of TCSs, but they vary 
in the number of phosphorylation sites on the HK. The systems in S. cere- 
visiae and B. subtilis both have a total of four phosphorylation sites, but 
they are distributed on three and four proteins, respectively. 

bacterial genomes have revealed the presence of many genes coding for HKs 
and RRs likely to be involved hitherto unknown phosphorelays O [15]. For 
example, 62 such genes have been identified in E. coli, which amounts to 
more than 1% of the entire genome [5]. Furthermore, the genes have been 
shown to be involved in a multitude of processes like stress response, osmotic 
regulation, virulence, and chemotaxis [T6], which illustrates the importance 
and ubiquity of phosphorelays. 

Given the widespread occurrence of phosphorelays, it is only natural to 
ask what the benefits of such an elaborate signaling mechanism are. Among 
the phosphorelays known today, none have more than four phosphorylation 
sites in total [H Hj, however as illustrated in Figure [T| the architectures may 
differ in the number of phosphorylation sites on each protein. One may thus 
speculate that whether the phosphorylation sites are located on one or more 
proteins influences the function of the phosphorelay, and that the benefits 
of a phosphorelay quickly saturate (or are balanced by drawbacks) with an 
increasing number of phosphorylation sites. 

Mathematical modeling has been applied to study various types of biolog- 
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ical networks, e.g enzymatic reaction networks [I71[IHl[I21l2niEIl[221[22l[21] 
and signaling cascades [251 EHl EH EH EHl EQl EH [32] , and has provided in- 
sight into steady-states, response to external stimulus, and robustness to 
changes in protein levels and kinetic parameters |33l IMl EH |36l [371 138]. Pre- 
cise measurements of concentrations and reaction rates are often difficult to 
obtain, and modeling can assist by determining whether e.g. the number of 
steady states and the qualitative stimulus-response behavior is intrinsic to 
the network architecture and not dependent on the actual concentrations and 
reaction rates. 

Here we develop a general model of phosphorelays of any size and archi- 
tecture based on mass-action kinetics. The model extends existing models of 
phosphorelays |39l HO] , and using an algebraic approach developed in [2H] we 
analytically analyze the model without resorting to numerical simulations. 
We prove the existence of a unique stable steady-state and show how it varies 
with changing model parameters. Furthermore, we obtain explicit expres- 
sions for stimulus-response curves. This allows us to derive an upper bound 
on the response coefficient in the bottom layer of any phosphorelay irrespec- 
tively of size and architecture, which is in agreement with what has been 
observed in both experiments and numerical models [lOl E]. Furthermore, 
we show that even for small phosphorelays (comprising only three phospho- 
rylation sites), qualitatively very different response patterns are possible, 
and we derive explicit conditions on reaction rates and substrate concen- 
trations describing each pattern. This contrasts what has previously been 
reported using simulation studies where saturation of phosphorylated sites 
at the bottom of the phosphorelay was suggested to cause a rise in response 
to sequentially propagate up through the phosphorelay [10]. 

Convergence and stability of the steady-state is proved using the theory 
of monotone dynamical systems [^ [13] , which also provides the existence 
and uniqueness of the steady-state. However, our more direct algebraic ap- 
proach to solving the steady-state equations is rewarded in that the calcula- 
tions naturally extend to analytical results on the stimulus-response behavior. 
Combined with recent systematic approaches for reducing the complexity of 
the equations to be solved [^ HS], we hope that similar direct, analytical 
calculations will become tractable for other chemical reaction networks too. 
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2 The Model 



We consider a general phosphorelay system consisting of M > 2 substrates 
S^, S"^, . . . , S'^'^ , where the mth substrate S"^ has A^^ > 1 phosphorylation 
sites (see Fig. [2]). We assume that substrates are never phosphorylated at 
more than one site at a time and denote by S*^ the mth substrate phospho- 
rylated at its nth site with n = corresponding to the unphosphorylated 
state. We refer to the set of all phosphoforms 5™ with < n < Nm as the 
mth layer of the phosphorelay and to as the length of the mth layer. 

We assume mass-action kinetics and that phosphate transfer within a 
substrate happens sequentially 

S"^ ■ ■ ■ S"^^ for l<m<M, (1) 

with positive reaction constants a^.n and bm,n, and we refer to these as in- 
tralayer reaction rates. The transfer of phosphate groups between substrates 
in two different layers is modeled via the formation of intermediate complexes 

+ S^+^ X" Sl^ + 5™+^ for 1 < m < M, (2) 

with positive reaction constants Um, Vm, and Wm- That is, only when S"^ is 
phosphorylated at its last site can it transmit phosphate to the next layer. 

Finally, we assume constant rates of phosphorylation (resp. dephospho- 
rylation) of and Sff^^, respectively, represented by two reactions 

S'.^Sl and Sl,^^S^^. (3) 

The system is essentially linear with each new layer introducing a new 
substrate. However, the mechanism of phosphorylation in the top layer is dif- 
ferent from the phosphotransfer mechanism between the subsequent layers. 
Similarly, dephosphorylation of the bottom layer is different from the dephos- 
phorylation mechanism in the other layers, which is also phosphotransfer. 

The stimulus activating the relay is implicitly captured in the reaction 
constant c. Increasing c corresponds to increasing the stimulus. When c is 
very low, most of the substrate will remain unphosphorylated, whereas 
higher values of c will push the substrate towards the phosphorylated phos- 
phoforms. The final response Sff^^ transmits its phosphate group to a recep- 
tor molecule, and this is modeled as a loss of the phosphate group without 
details about other molecules potentially involved in the process. 
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Figure 2: Schematic illustration of a general phosphorelay comprising M 
layers. The number of phosphorylation sites in the mth layer is N^, and 
the transfer of phosphate from one layer to the next is mediated via an 
intermediate complex. 



To avoid cumbersome notation, we denote by S both the species S and 
its concentration. It should always be clear from the context what is meant. 
Under the assumption of mass-action kinetics, the reactions ([T|, ([2]), and ^ 
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give rise to a set of differential equations, 
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By direct inspection it follows that 

4™ + + ■ ■ ■ + S"^^ + X'^-i +X"' = 0, (4) 



for all 1 < m < M, where we have defined X*^ = X = in order to simplify 
notation, and hence the sum 

cm C"i I c'Ti I I CTi I vm—l , \rm fr\ 

Stot = ^0 +^1 +■■■ + +X +X , (5) 

is conserved for all 1 < m < M. This reflects the fact that 5**" either exists 
in one of its Nm + 1 phosphoforms or is bound in one of the intermediate 
complexes X™~^ or X™. We will refer to S]^^ as the total amount of the 
substrate S'^ and to ^ as the conservation law for S*™. 

In the following section we prove that for fixed reaction constants and 
total amounts of substrate, the phosphorelay has a unique steady-state, and 
we use the insight obtained in the proof to investigate the stimulus-response 
behavior of the system. 

3 Results 

3.1 Steady- state equations 

The steady-state equations are the differential equations equated to zero 
along with the conservation laws for positive total amounts S^f., and the 
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steady-states are found by solving these for the variables (substrate phos- 
phoforms and intermediate complexes). Hence there is a steady-state equa- 
tion corresponding to each species as well as M additional conservation laws. 
Since there are M — 1 intermediate complexes, and each substrate S*™ ex- 
ists in Nm + 1 different phosphoforms, it follows that the system consists of 
3M — 1 + Yl,m=i equations in 2M — 1 + Ylm=i variables. 

To obtain a simpler system of equations that more clearly elucidates 
the constraints imposed by the phosphorelay structure, we manipulate the 
steady-state equations to obtain a simpler, but equivalent, set of equations. 

First note that according to (|4]), the equations S'^ = for 1 < m < M 
hold if = and X"^ = hold for all m and n ^ 1, and we may therefore 
leave them out. For all 1 < m < M, the steady-state equation X™" = is 
equivalent to the equation X™ + S^~^^ = 0, which in turn is equivalent to 

j^m ^ JLsM fo^ 1 < m < M. (6) 



m 



Furthermore, by replacing all S^^ = by the equivalent — 5™^^ = 0, it 
follows after inserting ^ that this is equivalent to 

g-^_, = ^'"'^"'^^- + ^^^-- for l<m<M. (7) 

a'm,Nm-l 

For 1 < n < Nrn — 1, the steady-state equation S'^j^-^ = is equivalent to 

^ (O-m.n+l + ^m,n+l)'S'^i - 6^,71+2 'S'.^a Km < M (8) 

and using induction, we may combine ([T]) and ([s]) in one equivalent statement, 

gm ^ Bra,nSN^ +dCm,nS^[^ 1 <m<M 

Am,n l<n<N^, ^ ^ 

where the constants are defined by 

i=n i=n+l i=n+l j=n+l 

for 1 < m < M and < n < N.^- In particular, these definitions imply 
that Am,Nrn = Bm,Nm = Cm,Nrn = 0, and Cm,N,„-i = 1. Apart from Cm,Af„, 
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the constants are all positive and depend only on the intralayer reaction 
constants a^.n and bm,n in the mth layer. 

Using Q and Q, we see that the conservation law ([s]) is fulfilled if and 
only if 

= SZ - XmS^^ - f^mS^^ for l<m<M, (11) 
with constants given by 

A„ = d^ + ^ + 5:^ and = (12) 

n=l ' n=l ' 

(terms involving the undefined rates Wq and wm are removed). The constants 
are all positive and depend only on reaction rates in the mth and (m — l)th 
layer. Finally, using ^ it follows that = is equivalent to 

cSl=dS^[^ and d{^^ + l)S^[^=u^^^S^-\S^ for 1< m < M. 

"^m— 1 

Summing up, the set of steady-state equations are replaced by an equivalent 
set of equations. 
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with constants defined in (10) and (12). Note that the reaction rate c only 
appears in (SSI). 

Throughout this paper we assume that all reaction constants and total 
amounts are fixed and positive unless otherwise clearly stated. Any solution 
to the steady-state equations is a steady-state, and the system could therefore 
possess multiple steady-states, some of which with negative concentrations. 
These are not biologically obtainable, so the focus is on steady-states in 
which all concentrations are non-negative (zero or positive). We call these 
biologically meaningful steady-states (BMSSs). 
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3.2 Existence of a unique stable BMSS 



In this section we prove the existence of a unique stable BMSS for a general 
phosphorelay. We do so by writing all steady-state concentrations as rational 
functions of the final response (recall that a rational function in x is 
a quotient f{x)/g{x) of two polynomial functions in x) and then show that 
precisely one value of S^^ gives rise to a BMSS. 

Starting with the Mth layer, we work our way to the top layer by layer. 
The hnk between layers is obtained by relating the steady-state value of 
S^^ with that of Sff^ through a rational function S^^ = ^m{S^J. The 
singularities of i/jm for 1 < m < M provide a necessary condition S*^^ < 
for non-negative concentrations in the layers m,m + 1, . . . , M, and we prove 
that < ^2 < • • • < Cm-1, from which it follows that SfJ^ < is necessary 
for all concentrations to be positive. We then write c = V'o('S'^) as an 
increasing rational function of S^^ and demonstrate how this leads to a 
stronger necessary condition S^^^ < ^o- Finally, we show that for any given 
value of c, the equation c = ipoiS^f^) has a unique solution S^^ in [0, ^o), 
which estabhshes the existence and uniqueness of a BMSS. In fact, it turns 
out that all steady-state concentrations are strictly positive. 

Note that (SS2)-(SS4) express and 5,'^ ioi < n < N„, as rational 
functions of S"^^ and S"^^ with coefficients depending on the intralayer reac- 
tion constants in the mth layer and the reaction constants d, Wm, and w^-i 
only. We now show how (SS5) yields the link to express all S'^^ as rational 
functions of 5"^ . 

We first show that at steady-state 7^ for all 1 < m < M. If this is 
not the case, there is a largest m for which S*™ = 0, and (SS5) then implies 
that Sf^^ = 0. For m = M, (SS4) implies that = 0, which contradicts 
the assumption of positive total amounts. For m < M we argue as follows: 
Since m is the largest with the property = 0, we have -S'^'*'''^ 7^ 0, and 
combined with Sff^^^ = 0, it follows from (SS5) that = 0. Now using 
(SS4) yields S^^ = 0, which again contradicts the assumption of positive 
total amounts. 

Since is non-zero at steady-state, we may isolate S"^^^^ in (SS5) and 
use (SS4) to get 



im—l 

'iVm-l 




for 1 < m < M, (13) 
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which shows that if we define ipm recursively hy ipM = id, and 

d(^^ + l)y 

^m-i{y) = 7 TTY 1< m < M, (14) 

then ipm{S^^^J = S^^ at steady-state. The recursive definition imphes that 
ijjm is a rational function. Furthermore, by isolating c in (SSI) and inserting 
5*0 from (SS4), it follows using Slf_^ = 'ipiiS^f^J that c = 'ipoiSf^^J, where 

My) = ryr (15) 

is also a rational function. 

Writing ^M{y) = PM{y)/qM{y) with pM{y) = y and quiy) = 1, we may 



use (14) and (15) to recursively write all ipm{y) as quotients Pm{y)/cim{y) 
with Prn(O) = 0, where both pm and qm are polynomials of degree M — m for 
all < m < M. 

Proposition 3.1. The steady-state equations (SS1)-(SS5) are satisfied, 
if and only if (SS2)-(SS4) are satisfied along with ipoiSff^^) = c, and 
MiS^'J = 5X?,„ for alll<m<M. 

Furthermore, for all m < M the function ipm has a minimal positive 
singularity satisfying 

^M-l > 6/-2 > ■ ■ ■ > 6 > ^0 > 0. 

Let = C,M+i = oo. Then ipm is continuous, non-negative and strictly 
increasing on [0,,^m); negative on {C,m,C,m+i), arid it satisfies ipm{0) = and 
i^miy) oo for y ^ for all < m < M. 

Proof. The first part of the proposition follows immediately since the equa- 
tions i'oiS^^J = c and i'miSff^J = S^^ are just rearrangements of (SSI) 
and (SS5), respectively. 

For the second part, the case m = M is trivial since ipM = id, and 
(^M,^M+i) is the empty set. Assume now that the claim is true for m + 1 
and consider the case m. By induction, ipm+i is increasing on [0, ^m+i), so the 
denominator of ipm is continuous and decreasing on [0, ^m+i), and it diverges 
towards — oo for y — )■ Therefore it has a unique zero < ^m+i- 

Furthermore, the numerator of ipm is continuous and increasing and equals 
for y = 0, and therefore the entire fraction ipm{y) is continuous, positive, and 
increasing on [0,^^), negative on {^m,^m+i), ^m(O) = 0, and ipm{y) oo for 
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Theorem 3.2. For any set of fixed positive reaction constants and total 
amounts, the phosphorelay converges to a unique stable BMSS. In fact, the 
steady-state concentrations of all substrates and intermediate complexes are 
positive. 



Proof. It follows from Proposition 3.1 that > at steady-state, if and 
only if Sff^^ is in [0, ^m), and since < ^2 < ■ ■ ■ < Cm-i, it follows that Sff^^ < 
^1 is a necessary condition for a BMSS. According to (SS2), we have X"* > 
for 1 < m < M for any Sff^^ > 0, and by inserting 5*]^^ > into (SS3), 
it shows that also S"" > for all 1 < m < M and 1 < n < Nm- Finally, 
because C,m by definition is the smallest positive root of the right-hand side 
of (SS4) after substituting S'ff^ = i^miSffJ, it follows that > for all 
1 < m < M. The argument also implies that all steady-state concentrations 
are positive if and only if S^^^ > 0, and since iPq{S^^) = c > 0, this is always 
the case. 



According to Proposition 3.1, the function -00 is continuous and increases 



from to cxD on [0,^o) and is negative on (^c^i)- It follows (see also Fig. [3]) 
that precisely one value of S^^^ in [0, ^0) satisfies the condition c = 'ipoiS^^^). 
This establishes the existence and uniqueness of a BMSS. 

The convergence and stability part can be proved using methods from the 
theory of monotone dynamical systems (see Theorem 2 in |12]), and a proof 
is included in O □ 




Figure 3: The graph of ipo for a three-layer phosphorelay with all reaction 
constants equal to one and all total amounts equal to ten. 



12 



The proof of convergence and stability in [C] also implies existence and 
uniqueness of a BMSS, but the proof is not constructive and does not yield 
the additional insight provided by the functions ipm- On the other hand, 
our approach does not address the convergence to and the stability of the 
steady-state, and the two methods thus complement each other. 



4 Stimulus-Response 

In this section we demonstrate how the functions ipm may be used to explicitly 
describe stimulus-response behavior. 



4.1 Maximal response 

Let all total amounts and all reaction constants but the stimulus c be fixed. 



According to (15), the stimulus is an increasing continuous function of the 



response in [0,^o) and hence, vice versa, the response is an increasing con- 
tinuous function of the stimulus. Furthermore, Sff^^ — )■ ^oi c — )■ oo, and 
therefore .^o is the smallest upper limit on all possible responses. The limit 
is not attainable but can be thought of as the response in a fictitious system 
with infinite stimulus, and we will refer to it as the maximal response of the 
phosphorelay. 



As argued in Section [3^ the rational function is the ratio of two poly- 
nomials of degree M, and calculating the maximal response is thus equivalent 
to finding the smallest positive root in a polynomial of degree M. 

More generally, in a phosphorelay with all total amounts and all reaction 
rates but c fixed, we denote by pm the smallest upper limit of all possible 
steady-state values of S^^ and call it the maximal response in the mth layer. 



We have just argued that pm = ■Co; and since according to Proposition |3.1 
all ipm are increasing functions on intervals containing [0,^o)) we have 

Pm = V'm(pAf) for all 1 <m< M. (16) 

Since tpm is invertible (it is increasing and continuous), we have that 5"^ 



M 
Nm 



i^rni^Nm)^ and by substituting this into (14) we obtain 

c={iJooij-'){S'^J for all 1 < m < M, (17) 
which is the stimulus expressed as a function of the response in the mth 



layer. Note that since (17) involves the inverse of a rational function, it is. 



in general, not itself a rational function. 
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The explicit stimulus-response relationship may be used to investigate 
how changes in one layer mo are reflected in the maximal responses in all 
layers of a phosphorelay. Suppose that A^o or /^mo is increased by changing 
reaction rates or by adding more phosphorylation sites to the substrate 5''"° 



in an existing layer (see ( 12 )). Then the maximal response decreases (resp. in- 



mo 
tot 



creases) in layers below (resp. above) tuq. Increasing the total amount S] 
has the opposite effect. Then the maximal response increases (resp. de- 
creases) in layers downstream (resp. upstream) from layer mo. This is il- 
lustrated for M = 5 in Figure |4j\, and proofs of both claims are given in 



A.l The responses themselves exhibit the same behavior, and a proof 



of this is included in |A.2[ Summing up, these results enable us to predict 
how all layers in the phosphorelay respond to changes in kinetic parameters 
and total amounts. 

By removing the top layer from the system and adding a new stimulus 
reaction Sq ^ Sf, we obtain a smaller phosphorelay with M — 1 layers, and 
its maximal flnal response is the minimal, positive zero of S^^^ — — fJ'2'ip2{y) , 



which is exactly from Proposition 3.1 In general, removing m layers from 



the original system results in a smaller system with a larger maximal flnal 
response equal to ^m, and this is illustrated for M = 6 in Figure |4^. With 
m layers removed, the phosphorylation S'™'*'^ A- S^'^'^ is direct, whereas 
in the larger system, some of the S"^^^ taking part in the phosphorylation 
(phosphotransfer) is sequestrated in the intermediate complex X™. 

4.2 Ultrasensitive response 

In this section we use the functions tpm to describe how steady-state concen- 
trations respond to changes in stimulus. For any < e < 1, we denote by 
Cm F the amount of stimulus needed in order to obtain e times the maximal 



response in the mth layer. That is, using the notation introduced in (16), we 
have 

Cr„,e = (V^O O V^m^)(£Pm) = ^0 (^m^ (^V^m (PA/) ) ) • 

The normalized response in the mth layer is the response divided by 
its maximal value pm, and plotted as a function of c we refer to it as the 
normalized stimulus-response curve for the mth layer. The curve consists of 
the points {cm.,e,£) for < e < 1, that is e is the normalized response. 
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Figure 4: A) Maximal responses in all layers of a five-layer phosphorelay 
as functions of S^^^. When Sf^^ increases, the maximal response increases in 
layers 1, 2, and 3, but decreases in layers 4 and 5. B) Stimulus-response 
curves for the bottom layer in phosphorelays with 6, 5, 4, 3, and 2 layers, 
where smaller systems are obtained from larger by removal of upper layers. 
All reaction rates are set to one, and all total amounts are set to 10. 



Proposition 4.1. For all m < M and Q < e < 1 we have CM,e < Cm,£- That 
is, the normalized stimulus-response curve for the bottom layer is shifted to 
the left of the normalized stimulus-response curves for all other layers. 



The proof uses induction on m and it is given in |A.3 The result in 



Proposition 4.1 cannot be extended to compare arbitrary layers, and we now 
demonstrate how it already fails for M = 3. In fact, it turns out that, 
depending on the reaction rates and total amounts, we can have ci^e > C2,e 
or ci^e < C2,£ for all < e < 1, and in some cases the normalized stimulus- 
response curves for layers one and two intersect as illustrated in Fig|5| Since 
ipi and iIjq^ are increasing functions, comparing ci^^ and C2,e is equivalent to 
comparing 

(V^i o 7/>o-i)(ci,e) = £^i(p3) and (^1 o ^o"i)(c2,,) = ^l(^2"'(^V'2(p3))), (18) 

so it follows that comparing ci^e and C2,e is equivalent to determining the sign 
of A(£) = e'il)i{pz) — ip\{il)2^ {e'il)2{pz))) ■ The expressions in (18) are easier 



to work with than the original ones, since we may calculate them explicitly. 
The maximal response is a root of a quadratic polynomial, and -0^^ may 
be obtained directly, since il)2 is the ratio of two first degree polynomials. 
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Stimulus Stimulus Stimulus 



Figure 5: Normalized stimulus- response curves for a three-layer phosphore- 
lay with one phosphorylation site at each layer. Here 8"^^^ = 20, S^^^ = 5, and 
all reaction rates are set to one. Then e* = 35/p3 — 15, where ps depends on 
3}^^, and by varying S^^^ we obtain three qualitatively different behaviors of 
the normalized response curves. The stimulus is on logarithmic scale. 

By manipulating A{e) (see[B]for details), we see that its sign is determined 
by the roots of a polynomial of degree three in e. We find that both and 1 
are roots, and the third root is 

^* ^ W2U2{Slt{X3 + P3) - X2Slt){Slt - (A3 + P3)P3) - d{v2 + W2)p2^tot 

dUi{v2 + W2)fl2{X3 + fl'3)P3 

It depends both on the reaction rates and the total amounts and may be 
calculated explicitly. We find that if £* < (resp. e* > 1), then ci^e > C2,e 
(resp. Ci^£ < C2,s) for all < e < 1, whereas if < e* < 1, the normahzed 
stimulus-response curves intersect for e = e*, and Ci^^ > C2,e (resp. Ci^^ < C2,e) 
for e < e* (resp. e > e*). 

We now continue our general investigation of how steady-state concen- 
trations respond to changes in stimulus. For 0<£:<5<1, we consider the 
response coefficient 

Xm,e,s = — for l<m<M, (19) 

Cm, (5 

which relates the amount of stimulus required to obtain e (resp. 6) times the 
maximal possible response in the mth layer. Since the response in any layer 
is an increasing function of the stimulus, it follows that 

< Xm < 1 for 1 < m < M. 
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Often one puts e = 0.1 and S = 0.9, and larger values of Xm,o. 1,0.9 then 
indicate a switch-like response in the mth layer. In the literature, systems 
with Xm.,0.1,0.9 > 1/81 are often referred to as ultrasensitive [25]. This is 
illustrated in a five-layer example in Fig. |6| where the intermediate layers 
(in particular the third) exhibit switch-like behaviors. On the other hand, 
the top layer shows an almost linear increase in response before reaching a 
plateau. 




0.2 0.4 0.6 0.8 1.0 



Stimulus 



Figure 6: Normalized stimulus-response curves for a five-layer phosphorelay 
with one phosphorylation site at each layer. Here 5*^^^ = S^^^ = Sf^^ = Sf^^ = 
10, = 5, and all reaction rates are set to one. The response in the top 
layer increases almost linearly before it reaches a plateau. The third layer 
shows a switch-like (ultrasensitive) behavior. 



Proposition 4.2. For a general M -layer phosphorelay we have XM,e,5 < ^1^- 



Proof. It follows immediately by using (15) that 

CM,e £ S^ 



XM,e,5 



tot 



Cm,5 



^ ^tot 



AiepM - PiV^i (£^Pm) 



and since ipi{y) according to Proposition 3.1 is an increasing function, it 
follows that in the second fraction, the numerator is smaller than the de- 
nominator, and this proves the claim. □ 



The result in Proposition 4.2| shows that for any set of reaction rates and 
total amounts, the degree of ultrasensitivity in the bottom layer is bounded 
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by the same constant (Xm,o. 1,0.9 < l/S)? this is thus an intrinsic feature 
of the phosphorelay. 

We are unaware whether the response coefficients Xm,e,s are bounded for 
general m. Numerical experiments indicate that also Xi,e,<5 < but we 
have not been able to determine this analytically. However, it is possible 
to calculate the response coefficients in some limit cases, for example when 
the total amount Sl^^ in the top layer is increased or decreased, which could 
e.g. be used in an experimental setup where S}^^ can be controlled. The proof 
of Proposition 4^ below is given in |Xj 



Proposition 4.3. Let 1 < m < M and 1 < e < S < 1, and let all reaction 
constants and all total amounts except S'/^j be fixed. Th 



en 



Xm,e,s ^ — ^ for Sit 



6(1-6) 



1-S 
1-e 



if m = 1 



Xrn., ^ < ^fl<m<M for S^^oo, 



e 
• S 



if m = M 

and > s/5. 

Fore = 0.1 and 5 = 0.9, the limit [e{l-6)]/[S{l-e)] is 1/81, the common 
threshold for ultrasensitivity, and for sufficiently high Sl^^^, the intermediate 
layers will exhibit higher degrees of ultrasensitivity than the bottom layer. 
Note that the limits are not necessarily global bounds on the response coef- 
ficients as illustrated in Fig. [7} 



5 Discussion 

In this paper we have introduced and analytically analyzed a general model of 
phosphorelays, which extends existing models of phosphorelays [33110], and 
we have proved the existence and uniqueness of a steady-state. Furthermore, 
we have derived explicit formulas for the responses in all layers as functions 
of the stimulus and used these to investigate various aspects of the stimulus- 
response behavior. 

We have showed that the response coefficient in the bottom layer of any 
phosphorelay is bounded by constants independent of size and architecture 



18 



r.1 



Figure 7: Response coefficients for a five-layer phosphorelay with one phos- 
phorylation site at each layer. Here S^^^ = Sf^^ = Sf^^ = 10, Sf^^ = 5, and all 
reaction rates are set to one. The second plot emphasizes the behavior for 
small values of S}^^ and reveals that response coefficients are not necessarily 
increasing functions of S}^^. 

of the phosphorelay. Furthermore, we have also demonstrated how qualita- 
tively very different stimulus-response behaviors are possible in layers above 
the last, and in the three-layer case we have derived an exact condition which 
distinguishes the three possible scenarios in that case. The variety of behav- 
iors contrasts what has been reported in previous studies using numerical 
simulations |40j. 

The finding that the response coefficient in the bottom layer is bounded is 
consistent with experimental findings. For example, in the four-layer phos- 
phorelay involved in sporulation initiation of B. subtilis (see Figure [T]), it 
has been observed that the response (the concentration of SpoOA~P) is 
only gradually increasing with the stimulus [H]. In fact, the authors ar- 
gue that this is an essential feature of the phosphorelay, since by increasing 
the stimulus, sporulation is observed, whereas by artificially activating only 
SpoOA~P, hardly any sporulation takes place. It has been shown the ex- 
pression of at least 121 genes is directly regulated by SpoOA~P, and that 
these are activated/repressed at very different concentrations of SpoOA~P 
[46j . It is therefore speculated that the intricate process of sporulation initi- 
ation requires several steps mediated by the activity of some of these genes. 
This suggests the importance of gradually increasing the concentration of 
SpoOA~P, since a rapid increase would bypass the intermediate steps [H]. 
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Ultrasensitivity in intermediate layers has previously been suggested us- 
ing a simpler model [ID], but to our knowledge no experimental studies have 
determined whether or not this happens in vitro. The presence of intermedi- 
ate layers allows for additional control of the response, where e.g. an increase 
in stimulus my be counteracted upon by removal of phosphate in an interme- 
diate layer. For example, there are phosphatases RapA, RapB, and RapE, 
which are known to dephosphorylate SpoOF~P, and SpoOE which is known 
to dephosphorylate SpoOA~P [121 SZl SH] • We speculate that the ultrasen- 
sitivity in intermediate layers is essential in facilitating switch-like cross-talk 
with external pathways. 

We have argued that as the number of layers is increased, the maximal 
final response decreases. In the example in Figure |4| the effect appears to 
saturate already for five layers, a feature not specific to the selected values 
of reaction constants and total amounts. In fact, the saturation is often 
observed even earlier. This suggest that the saturation is an intrinsic feature 
of the phosphorelay structure itself and not the specific reaction rates and 
total amounts. This fits with the fact that all known phosphorelays to this 
day contain at most four sites |t2j. 

This paper demonstrates that even relatively complicated systems such 
as phosphorelays may be treated analytically. Important features of chemical 
reaction networks may be overlooked if one resorts to numerical simulations 
alone. Using our approach, previously developed and applied to signaling 
cascades and enzymatic reactions [281 133 ED], we are able to derive exact 
and qualitative results about steady-states and stimulus-response behavior 
for any phosphorelay independent of the number and length of layers, re- 
action constants, and total amounts of substrate. Also this approach, by 
providing simple (recursive) expressions relating species concentrations at 
steady-state, allows for fast and efficient numerical analysis thereby avoiding 
computationally demanding and error-prone calculations of e.g. steady-state 
values. 

A Proofs 

Proposition A.l. // Xmg or fimo is increased, or if the total amount of 
substrate is decreased, then the maximal response decreases in layers 
m > mo and increases in layers m < niQ. 

Proof. We add bars over functions and constants in the modified system to 
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distinguish them from the original ones. The function iprn only depends on 
reaction constants and total amounts in layers m + l,m + 2, . . . , M. This 
implies that corresponding to the modified system is equal to ipm for 



m > mo- However, according to (14) either one of the two modifications will 
decrease the denominator of ipmo-iiv) and hence increase iprno-i{y)- There- 
fore ipmo-iiy) > i'mo-iiy) for all ?/ > in the overlap of the domains of 
definition of iprnn-i ^"^^ i^mo-i, and using the recursive definition of ipm-i 



(14), we obtain iprniu) > '^m{y) for all m < mo. Therefore, 

SZt-^mV -Jlmi^rniy) < ^mV - f^m^miy) for m < TTIq, (20) 



where the case m = rriQ follows from the assumption that either 5*)^° < 5'^'^°, 
Since, by definition, ^m-i (resp. ^^-i) is the smallest, positive zero of the 



right-hand side (resp. left-hand side) of (20), we see that < im. for all 
m < rriQ. In particular, p^j = < 'Co = Pm^ and since the are unchanged 
for m > mo, we get p„ = i^^ipu) = ^mipu) < i'mipu) = Pm for m > ttiq. 

It remains to show that the response decreases in layers upstream from 
mo, and we first consider the case m = 1. By the definitions of pM and p^, 
we have S}^^ - XipM - PiV^i (pm) = and S}^^ - XiPm - Pii^iiPhi) = 0, so 

Pi = MPm) = " > ^^-^^ = Mpm) = P. 

Pi Pi 



Using (14) recursively, we see that 

qm+l ^ ^ d(^ + l)pM 

"^tot — ■^m+lPM \Wn y^^*^ 



Pm+1 UmPm+li^mipM) 



which for m < mo — 1 does not involve the modified parameters, and since 
^i(Pa/) > V'i(Pm), induction shows that p^ = i^mipu) > ^mipu) = pm for 
all m < mo, which concludes the proof. □ 

Proposition A. 2. // Am^ or p^o is increased, or if the total amount of 
substrate is decreased, then the response S^^ decreases in layers m > niQ 
and increases in layers m < mo. 



Proof. As already argued in the proof of A. 2, we have = ipm (resp. ^/'m < 
ipm) for rn > ttlq (resp. m < mo) in the overlaps of the domains of definition 
of the respective functions. 



21 



Let S'^^ and S*™^ be the steady-state values of the response in the mth 
layer in each of the systems. We have ^PoiS^^J = c = ^poiSff^J > ^oI'S'tvaJ, 
and since ipQ is increasing it follows that S^^ < . Then using that ip^ 



m 



is increasing, we get = ^^(sJ^^J = V'm(^Jl^^J > V'm(5j^i,) = S"^^ for 
all m > rriQ. By isolating ipiiy) in (15) and using iPq{S^ ) = ipoiS^' ) and 



Snm < ^Nm^ set 

{ qM \ _ ( ql X qM ""^Nm 

<i(sL-A.C-^||^)=*.(s". 



and from here it follows inductively using ([14j) as in the proof of A.l that 
^1 = i^miSNj < ^m{S^J = for all m < mo. □ 
Proposition A. 3. cnj,e < Cm,e for all m < M and < e < 1. 

Proof. Using the definitions of CM,e and Cm,E, we obtain CM,e = '?/'o(^Pm) 
and Cm,e = ''Poii'm^i^i'mipM))), and since both ipm and ipQ^ are increasing 
functions, cm,£ < c^.e if and only if ^^(^Pm) < ^i'miPAi)- 

In the case m = M, we have ipMi^PAi) = ^Pa/ = ^V^m(pm)- Hence it 
suffices to prove that tpmi^PM) < ^i'mipu) implies ipm-ii^PM) < ^i^m-iippi), 
and this follows using epM < Pm, since 

d(^^ + l)epM 

Wm-lK^pMj 



< ^ 7^ TV = efm-l{pM), 

Um-l[Jtot ~ ^mPM — PmWmKpM)) 

which finishes the proof. □ 

Lemma A. 4. Let all reaction rates and all total amounts except 3}^^ be fixed. 
Then — ?• for S^^^ — )■ oc and Pm ^ for 8}^^ — )■ 0. 



Proof. By definition, pM is a root in the denominator of (15), and hence 
"^tot = XiPm + Piipiipn)- This function is continuous and increasing on 
[0,^i), equals for pm = 0, and tends to infinity when — )• . The 
function is thus invertible, say pu = '^{S^^t)^ such that ip is continuous and 
increasing with (p{0) = and satisfies ^{8}^^) — )■ for 8}^^ oo. □ 
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Lemma A. 5. For all m < M , the functions ipm o-nd satisfy 



+ 1 



m+1 



and {ip^ )'(0) = u^Sf 



m+l 
tot , 



+ 1 



Proof. The first statement follows by differentiating the recursive expression 
for ipmiy) (14) and inserting y = 0, and then the second statement immedi- 
ately follows from (V'-^)'(O) = l/^PM-^O)) = 1/^(0)- □ 

Lemma A. 6. As a function of 8]^^, the maximal response pm satisfies 



dpM^^^ 



tot 



dS, 



tot 



(21) 



Proof. By differentiating S^^^ = XiPm + /^iV'i (Pm) with respect to 5/^^, we 
get p'^(O) = (1 - /iiVi(PM(0))p'M(0))/Ai = (1 - /ii^UO)p'M(0))/Ai, and by 
isolating Pjv/(0) inserting A. 5, we obtain the desired result. □ 



By plugging the expression (16) into the definition of the response coef- 
ficient (19), it follows that we have 



and below we will consider the factors am and f3m separately. 

Proposition A. 7. Let all reaction rates and all total amounts except S^^ be 
fixed. Then au = and 



for Sit ^ 



^/'m^(£^m(gl)) 



tot 

if m = 1 
ifl<m<M 



for Sit oo. 



and i^-He^mm)/i^;n\5^Pmm) > ^/S- 

Proof. Since ipM = id, it immediately follows that aju = {^Pm) / {^Pm) = s/8 
as claimed. According to A. 4, we have p — )■ for 5*^^^^ — )■ 0, so since 'ipmif^) = 0, 
it follows that is a 0/0-expression in the limit 5*^^^^ — )■ 0, and we may 
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apply L'Hopital's rule. For the numerator of (and analogously for the 
denominator) we have 



d 



and using that the results of A.5 and A.6 are non-zero, it follows that 



d 



dStot 



d 



dSlot 



for 



Slot ^ 0. 



For the limit 5*/^^ — ?■ oo, we consider first the case m 



1. Accord- 



ing to A. 4 we have pi = ipiiPu) oo for 5*^^^^ — t- oo, and hence ai = 
ilj^^{epi)/i/j^^{6pi) — >• ^i/^i = 1, The remaining cases follow from the first 
part of A. 4, Finally, since ipm is convex and increasing, the inverse is con- 
cave and increasing. Using ipm^iO) = 0, it follows that ip^{x)/x > ip^{ii)/y 
for all X < y. In particular, this holds for x = epm and y = 6pm, and hence 

Proposition A. 8. Let all reaction rates and all total amounts except 8}^^ he 
fixed. Then 



I3m 



/3m ^ 



1-6 




for 



Slot ^ 



if m = 1 
ifl<m<M 



for 



Slot oo- 



Proof. To simplify notation, we denote by fm,s and fm,e the numerator and 
denominator, respectively, of /3m- Note that is a 0/0-expression in the 
limit Sl^^ — )■ 0, and hence we may use L'Hopital's rule. Let z^^s = i^m^i^Pm) 
such that fm,s = Sl^^ - XiZm,s - Pi'ipi{zm,s)- Then 



dfn 



dSlot 



1-Ai 



dz„ 



dSlot 



#1 
dy 



dZr 



dSlot 



Now note that 



dZm,5 

dS} 



— [pipm [pM ) ) —T- [PM 



tot 



dx 



dy 



d^^ ' 

^>~>tot 
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and by plugging in the results from A. 5 and A. 6, it follows that dfm,s/dSl^t ~^ 
1 — (5 for Sjgf — 7- 0. Similarly, dfm,e/dSlot — )■ 1 — e, and hence L'Hopital's rule 
implies that (3m ^ {I - - e) for S^^^ 0. 

We have fi^s = Sj^t ~^ " f^i^Pii and by combining this with 

Slot = ^iPM + fJ'iPi, it follows that fi^s = K{pm - ^i^{5pi)) + Aii(l - 5)pi 
and hence 



_ Ai(pm - A ^{^Pi)) + - 5)pi _^ 1 

Pl — T — : — : ^ > 



Ai(pm - V^i ^(e^Pi)) + - e)pi 



l-e 



for 



Slot 



since pM and ^/'i ^ are bounded and pi — )■ oo for 5*4,4 ~^ For m > 1, we 
have ipmipAi) — > '?/'m(G) foi' 'S'/oi — 7- oo, and it immediately follows that 

P ^ Stot - Ai^~H<57/'^(Pm)) - PlM'^mi^'^miPM))) ^ ^ ^ OO 

Slot- ^li^mi^^miPM)) - PlMi^^^i^i^mipM))) *°* 

since the last two terms in both numerator and denominator are bounded. □ 



By combining A.7 and A.8 we obtain Proposition 4.3 from the main text. 



B Example 

Here we provide details about the calculations left out in the example in 
Section |4j Using the definitions of ipi and ip2, we may write A{e) on the form 

^ rgg^ + r2£^ + ne ^ R{e) 
~ t2e^ + he + to ~ T{e) ' 

for example using computer software capable of symbolic manipulation, where 
the coefficients rj and only depend on the reaction constants, the total 
amounts, and the maximal response p^. The coefficients of the polynomials 
may be chosen such that t2 <Q and both T(0) and T(l) are positive. Hence 
T is a second degree polynomial with negative leading coefficient, and it as- 
sumes positive values in the end points e = and e = 1. Therefore Ti^e) > 
for all < e < 1, and hence signA(e) = sign_R(£:). 

Since A(0) = A(l) = 0, it follows that i?(0) = = 0, and by factoring 
these trivial roots we obtain the last root as stated in the main text. For 
some constant r < 0, the polynomial R{e) factors R{e) = T-e{e — l){e — e*) = 
re^ — r(l + e*)e^ + Te*e, and hence sign_R'(0) = — sign(£:*). Summing up, 
we know all three roots of R{e) as well as the slope of R{s) at e = 0, which 
completely determines the sign of R{e) at any point. 
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C Convergence and stability of the steady- 
state 



We prove the convergence to a unique BMSS of the phosphorelay for any set 
of positive initial conditions using Theorem 2 in [12] . We will restate the 
theorem here, but first we introduce some concepts from |12]. To simplify 
notation, we use ^ to denote reversible reactions in inline text. 

For a reaction A ^ B, A is the reactant and B is the product, and for 
every reversible reaction, e.g. -H- 5"^]^, a direction is chosen so that the 
reactant and the product are well-defined. For the reversible reactions in ([T|, 
(|2]), and (|3|, we choose the left-hand side to be the reactant and the right- 
hand side to be the product. We have a total of ns = J2m=i ^rn + M — 1 
species and n/j = Ylim=i + M reactions in the system. Define the ns x riji 
stoichiometric matrix F such that the entry F^^^ corresponding to species s 
and reaction r is 1 if s is in the reactant of r, —1 if s is in product, and 
zero otherwise. Here orders on the sets of species and reactions are implicitly 
chosen. 

The directed SR-graph is constructed as follows: The set of vertices is 
the union of the set of species (called species nodes) and the set of reactions 
(called reaction nodes). If a species s takes part in a reversible reaction r or 
is part of the reactant of an irreversible reaction r, there are edges s — ?• r 
and r — )■ s. If s is part of the product of an irreversible reaction r, there is 
an edge r — )■ s. A siphon E is a non-empty subset of species such that if 
s G S is in the product of a reaction r, then S contains at least one species 
in the reactant of r. Here reversible reactions are considered as two different 
irreversible reactions, so that each side of the reversible reaction appears as 
product in one reaction and as reactant in the other. A siphon is minimal if 
it contains no siphon other than itself. 

Theorem 2 in ^2] states that all solutions of the phosphorelay ODEs in 
R"g converge to a unique equilibrium if the following four conditions hold: 

(i) The system of ODEs of the phosphorelay is persistent. 

(ii) For all species s and reactions vi ^ r2, the product —Ts^ri^s^r2 is non- 
negative. 

(iii) There is a directed path between any two reaction nodes in the directed 
SR-graph. 
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(iv) The kernel of F contains a positive vector. 

Remark. With the notions from |12], conditions (ii) and (iii) imply that 
the corresponding system in reaction coordinates is monotone with respect to 
the positive orthant cone, and strongly monotone in the interior with respect 
to that order. This is a consequence of Proposition 5.3 and the proof of 
Theorem 1 in [l2]. 

We will now prove (i)-(iv). By the choice of directions of reactions in our 
system, each species is on the left of exactly one reaction and on the right of 
exactly one reaction. It follows that for each species s there are exactly two 
reactions ri,r2 such that Ts^ri,^s,r2 ^ind further that they have opposite 
sign. Thus, r^^nr^.r^ < and zero for all other choices of reactions. This 
proves (ii). Each row of F has only two non-zero entries, and they are of 
opposite signs. Therefore the vector (1, . . . , 1) belongs to the kernel of F, 
and hence (iv) holds. 

To show (iii), note that for a fixed m, there is a path in the directed 
SR-graph between any two reaction nodes of the form 

For m = M the statement is true with the last two reactions replaced by 
do : Sff^^ — )■ Sq-' . Furthermore, there is a path from Wm to ri^m+i and to Cm-i, 
connecting reactions in different layers. There is a path from the reaction 
node Co : Sq ^ to ri_i and from di to cq. Therefore, a directed path 
between any two reactions of the phosphorelay exists, and (iii) holds. 

All that is left is to prove (i). For that, we use Theorem 2 in [13] that 
states that if (a) the network has a positive conservation law, and (b) there 
is a conservation law with non-negative coefficients on the species for each 
minimal siphon, then the network is persistent. Since each species of the 
phosphorelay is part of a conservation law with non- negative coefficients (|5|, 
it follows that (a) holds. 

If we show that the sets = {S^, . . . , 5]^^, X™-i, X"^} for m = 
1, 2, . . . , M (removing the non-defined for m = 1, M) are the minimal 

siphons, then the conservation law ([s]) ensures that (b) holds and the proof 
is completed. We construct a graph that gives an easy visual inspection of 
which the minimal siphons of the phosphorelay are. If r is a reaction that 
contains a species si in the reactant and a species S2 in the product, then we 
draw an edge si — )• S2 with label r. The graph is 
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^0^ 



SI 



S' 




qM 



qM 



where dm is as above, e„ : S^^ + S^+^ X"", and e'^: X"^ ^ S^^ + S^+\ 
The labels of the reactions r„^^ : 5"™ ^ 5"^^ are not shown. 
Let E be a siphon. Then inspection of the graph gives: 

(1) USl^ belongs to E for some n > 0, then so do S^^ for all n' > 0. 

(2) If 5*^ belongs to S for some n > 0, then so do and Further, 
if 5";^ or 5"^ belong to E then so do and , respectively. 

(3) If X*" belongs to E, then either 5™+^ or S^^ (and thus for all n > 0) 
belong to E. 

It is easy to see that the middle pentagon which contains the species in E^ is 
a siphon for all 1 < m < M, and conditions (l)-(3) ensure that it is minimal. 
If E is a siphon that does not contain E^ for any m, then (l)-(3) imply that 
it must contain X'^ for all m. If does not belong to E for any m, then 
by (3) S!^ belongs to E for all m and n > 0. It follows from (2) that so does 
Sq and El C E, thereby reaching a contradiction. Thus, there is an m for 
which belongs to E. Since S^^ does not (E„ ^ E), by (3) 5"^+^ belongs 
to E. We repeat the argument to conclude that e E. It follows from (2) 
that so does S}^^ and Em ^ E, again reaching a contradiction. Therefore, 
any siphon contains E^ for some m as desired. 
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